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(54) OPERATION SUPPORTING DEVICE FOR 
VEHICLE 

(57) Abstract: 

PROBLEM TO BE SOLVED: To provide a certain, 
reliable, and practical operation supporting device in 
which a driver can travel in a narrow road by evading 
contact with an obstacle by easily and quickly making 
accurate judgment. 

SOLUTION: A speed V and a handle angle 9 are 
detected, the environment of a traveling direction is 
image picked-up by a CCD camera 3, and the calculation 
of relative position information is operated by a 
picture recognizing part 21 and a road shape and 
obstacle recognizing part 22. When a narrow road is 
present in the direction of travel according to judgment 
by a narrow road judgment processing part 23, 
second-dimensional maps prepared in the past are 
successively updated, and the second-dimensional map 
of environment in the surrounding of a vehicle including 
the direction of travel is prepared by a 
second-dimensional map preparing part 25. Afterwards, 
an ideal path when the vehicle is intruding into the 
narrow road is calculated based on the second- 
dimensional map by an ideal path calculating part 26, 
and an expected position after the set time of a vehicle 
1 is expected on the second-dimensional map by an 
expected position estimating part 27. Then, an 
announcement controlling part 28 outputs a signal to a 



state display part 8, and the ideal path is synthesized 
with the expected position and displayed on the 
second-dimensional map. 
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^tf ±e i awnai ©s»»©flr B««s:^j«-r a Steffi 
% wtT&em®. <o ±ie a mpi <z? ^m&m &mi£-r a ^ 

Bo 

-e** L^±iEffiffi«8S t ±e^»ffiB*ij£#«-e*j£ 
Lit jt jB^ffflffia i irs<5# ±e a mma> ±ts^mm 

T0f^fc**i-« i £ ^mmb-r^w^m i xf±w*:* 
2 sattovffiA incase 

LfcJtSB«S«IS i -blB^fflffiBffi^©^*^ 
Lfc JilHHSffiB t tears* JbfE a JHPitf>-kf2^»teB 
®-hfBa«iBIK*»fe«Z)^ix*Srja3S-r'5 b b fete, 

[000 1] 

B(-Mi-a„ 
[0 0 0 2] 
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g-y^T-fe (ADA ; Active Drive Assist system) #5 
[0 0 0 3] J=ffi*m<B*ff««W**#Sfci{>©£« 

*iE-rtt*WK:«?«bfe*«c©*^ 7te<t 
~ b ifi sim^tiio x § x v ^ 0 

[0 0 0 4] iiEADA^^AGOfSligOO 3t?fca* 

TS*MebSfi/5Sfc'9, M%-\-£. tUf 6- 2 3 4 3 4 
e*ffiWS:*SU, 6*ttH»UW5tti 

20 $tVTV^„ 
[0 0 0 5] 

tTS^SI*K«S*:fii«S:U«S«(i« £ officii* 

[0 0 0 6] fa*$*aS^^W^^r^^ 

fc5o 

[000 7] #*Wtt±iE*4ffK:fi^-Cjfe ^tvfc^ro 

Srfifo tiSfe b <o&M%mm Lr*!IS*fTas-C# 5 J: 
3 te#-Y K-f SWUfc-CfBHtt, 

[0 0 0 8] 

^ r text a-t 5 mm<Dm^ * sse-t- a a^isas^ 

mcoJbfS g *j^03^fflfi!!:BSr*!£-r5 ^fflffiB*^® 
50 ±Eat«SffiB«f#»^«-e»riEU*:±Ea*m« 
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[0009] ±i5is*« i mm<o-&wimm$s$:mmm 

ff a^ft-C±E g *P5«)*fT*lft©itKJKtt i: St 

kims** s i^i- ±is § - ^^gg i- $ x-r ^ mm 

Lfc-UE g *P5«ffl©«#©ffi«flMi t ±isai®sss« 
[0 0 10] ^3R«2fE«^)*:^M(-J;5ffiffl 

*5^t, JLfEfft&^aia, iKat*fl«ijMwgjs#a-e 
^ Lfc±e g Mmmm(Dm$£e>tiLmmm±.K±.tzmm 
mmm&^mxmn LfcjhiEs;®gsg t JbfB^&B* 

[ooi i] *e>in x tt^afs*©*^^^,};^*:^ 
*B£«SS«fc::i3V-C, ±IE$B*n#aW\ JhfE3«gSS 

s@^a-esff Lfc±iHa©igss t JtfE^B{iB#£5£# 

«-C#je Lfc±fE^«fefii: KS-^ JhfBg JttpfijWJbfE 

[0012] m#m4%zm<D*:mwiz-£?>&ffim 
Mfc^mmmte. nxmi, 2, 3 ov>Tix*>— otie 

ies«isg?£»#a-c*&g ufc ±mmmmm t ±m^m 
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SSJ-ft 5 «fc 5 l-^-f K$*v5„ 
[0 0 13] m*«5Ctt<Z>43B9H£J:S4:ffi 

[0 0 14] 

M<nMm%mm-tz>o m 1 ~ia 9 \tt&wv>mm<z>m 1 

HI 1 (±*t^fflilteSa^B^t8^« y 
H 2 tt«^JBiE^a&B<0fEI^J$l2U 0314 

<zw§ia> H6«*:^)awSEfls:feteBif#cc>iftpjia^ 
20 s 0 

[0 0 15] EI2M:}31^T, ;f?#i ttgid*:^©*^ 

(g*s) r*fc<9, ^<^g*pgi \c mmmx<D»!^<D 

*U«^ P»*4fci©«f«l&JhSrH5*«BSr— o©»ttt 

fi2^»«$nTV^So KT, ^MoHIoglfi 

•ctt, *^ffl)i$5^:^B2(D^ggjiA©Brs : ©fiJ^ 
[ooi6] ±ta*i^fflSteS:S$lfi 2 fi, ^^u-^ 

30 *£Mb LXM7H-£mffi&-&m* (CCD) ^co@fls«^ 

rttb&^<DCCD^^9 3fi x ^ix^tv*^!*}^^^ 
mr*-i-— mcomm^^^x^.'oHifbn, i£ft<Dttgi& 

l&t£%&&frb^^*&&.-rZ>£ ! )\^£'2X\<^ 0 * 
Lt> ±fSlfficoCCD*^73-CiS^LfcgWl© 
*fT*-(«)K)^tt!ff #»4, ffiiJ»ISB 4 KKti § tbS J; 5 

[0 0 17] *fc, ±SBWfflS^g^B2tt. 
^ffi^ffi^airbT, -h|Ba*ii^lOiffi«S:^ffi-rs»: 
40 jg-fe x-^ 5iAy K/V'ft Srtft ^ V K/^ -fe v-^ 6 
^?>(7)=&m^-hfH$iJ^B4 J; 5 

^Htfc^ -hBEMffll^B4«±ai<?5#i*#f (CCD* 

-fe^f- 6 {-S-^v^T$fe^SiiAcoW^»*^J 

-t-s«tesraj*-r'<< , 7 1 ^*^«fp 8 t^Mffi 
[0018] ±!em$3§ 7 ^-efci?, 
50 tmmvBt<o&m<o'sitemiiiz>iR&Ki±'tB, 



[0019] *fc, ±iE^ffi^gc8tt, ±Mmmmm. 

K$$ffiHl , H2 , «£H3 ) £<0te«IMM», 

Pi i *sr.<z>**wiite#tffi K/^ e , 3£Pii*££ 
V) frj|«&Lfc*ft^0M:£i$Mft 2fJ>») © 

IS R R * JHfc 2 »c5c-v y T'-Cft JI6W«-*flH-6 

^WBHfcHSrJItfe-e £ v ^ 5 J: b y -m7*X*ffi 5 < 

[0 0 2 0] _tfEfliffl3£B 4 fi, -^r^n^^fa— * 
fc*r©«fflia»-C»f*;*;h^ 121 1 i'^-r J: 5 flttfeK 
tttt 2 l , 5lgg^#i • 2 2 , 3feB¥i|£fti3a 

SP2 3, g#»gP2 4 % 20C7C-^s/7°f^fig|fi52 5, S 

SUBBttJItt 2 6 , ^i»{£B*ft£Sl$ 2 7 , flUaHMfPffi 2 

[0 0 2 1] ±IHHIfe»f»^2 If*. JbfBCCD^77«7 
3 -c*«& Lfc i i o^fT^ftw^SiGo i |a«^-^ u- 

BiltlS»«t • ME«4bBMMB 2 2 i^W^i" 5 «£ 5 
[0 0 2 2] JblBiMSTBtt • M#4MBNk» 2 2 tt, ±E 

■ttBMiA 2 i frbvmffim&vs&mftmizov^x t * 

h ^ 7 J^&m&n b £ £ T-ifi8S • B#|MF0>£ft:4fe««: 

t±IB2 0:7c-v->'7 ,, ^gi}2 5 idW^-rs ± 5J-&oT 
v>-5„ 

[0 0 2 3] -T&;b*>±i£co<fc JifSCCD*^^ 

3 , HfiaBagp 2 1 *5 ixmssum®. - mmhmms 
2 2-c3feffai«afta#a**»j«s*i/TV'>s. 

[00 24] JLfB8a&¥iJj£*&Jffi8B 2 3 tt, JhfEitlSJgiK 

• nmmmmito 2 2 *» b At) ts *iit a Mm 1 n^m^n 

[0 0 2 5] ±fEt»j£*&H«:, 0ll^.f^|gJ 5 JCtix 

*tf*l^**fl»*©««-, *M»f>*!l2 0 
mS-CCO^ffi-e, £ Ijtffi 1 ODfltr^rl^jffiffi Lfc i fltpEj 1 CO 
tc.&<0&f*®m (03*.fi K7 5 7— ) ©gSHalL, alR 

a2L' , a2R' T'HiH5©Hi: LttSl/\ 
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[0 0 2 6] tLT, *fT^(Bl-efii{SjS*fcfi»lhUT 
v^<lpEk itSSffiSPtO^- Fi — /K £WJ, 
©»**©|IIIHIiS:H-ai LTitlS<St<©*KW«aMHSrttHl 

L)Mi <fc <3 /h $ < , #fl£roft;Mgte 1 0 cmCO^^-Sr^P 
»LfcffieA±&5^^SfeK*9 i:¥iJ5£LT±fE2#;:rc 

[0 0 2 7] ±|E$fe8S¥lJ3£*0 ! 3ia$ 2 

*uhip«is 2 4 imti-r & x b mfto t<^5o 
[0028] ±iBic«i<Mmi» 2 4 w:, ife^ssw^^a 

[0 0 2 9] ±fS2«>C7C^S'7 0 ^gP2 5f4, 

^lt. -htea«SKSs[mg|5 2 e ±iE^«fiB*i^ 

SP2 7^m^-T5 i5>{'^orVN5 0 

[0030] ±ia^:pj^iaco^fii:«w« ( 2 y 

g #n5 1 Sr^'fr i: i"5ffi^Q R S T rt<Oir(*:«Sj©ffiffifflf 

40 [oo3i] -r/jefc*,, wia«iiEbreitu-c*j^ytac 

(WWtBflMB©** (2j!>:7C-^-y7 P ) Q' R' S' T' 

♦ (ti-fliBM) ) , «ffct±Eais»« • mmmmn 

^TE^i/^^Q' R' S' T' Sr±lB»»*M«»t 
Q* R' S* T* d>?>, IElicffi^l-ttlfc'b»©7 :J -^ 

(«tss' T- <d?*-*) t. mtiizmz.m®PQ 

50 R©ttJtfif tSftlStSSiP E FOf-^ i: 4i 
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*U ±E«*PQRO«»ffiB1»«Sril»lLr^iaro 

[0 0 3 2] -ttrrcoj: 5^2^7C^5/^4:fflV^T^ 

o xMmmjj^ * o r l * o -ct^e 

^3E^Kjtf>B38Srfx 5 £ # <5 J: 9 ici^o TV^§ 0 
[0033] r rr\ tfeWbfcea:pii<^»»*S:S 

[0 0 3 4] H7j;:*3i^\ g Mm l ^acii-r 
A^C (xa , ya ) t£&54**fci\ BjK (xb , yb ) 
t£*#toK»lM*5 (xa =xb ) 0 rrT% ✓M'KA' 

fte\c£&mffeft%5 t-tzt, wmitni&te 6 = o x 

ffi^BMAMiU, yb =ya -AMir 
45 0 fiGtjfefT«FT?M\ (xold , yol 

d ) X*^1rmlv)(D 2&:5u'^ yy'te, MM (xnew , yne 

w) X^-T^comt-^ 2 y -?Xc\>XT<o 2 i: 

xnew = xold *** (1) 

x new = r • cos 
ynew = r • sin 

±.mmmm&mw& 2 6 «\ ±ie 2 <y 2 

rtl KiifeB *s fc 5 BS & *P5 1 * n ©*K icit a-t S 

*vr*5 0 , r <oj»s&tttft£8iE 2 e -e*»fca«aistt 

±K«*P«(«HB 2 8 fcW;*j SttS J; 5 K4otv>8„ 
[0 0 3 8] Mill 08 ( a ) \Z7jk-t& 0 XC^ g flER 

BGKLL2 i<DBB) r^^SSS PfcitA-rSfcfe 

fflJ2 5s5*e>*:W«ia<7>ffif«[i: UTH8 (b) |^*-TJ:5 
4 2?fc5c^^^SA*Stt5o 
[0 0 3 9] ^LT, H8 (c) IdT^i-J: 5 r (7) 2 

Hi, H2 oaSP5l{ffl<z>iiD»^O^SrPtli: U S 

[0 0 4 0] ZL<D&Pt2$:m&h U SfeKS P SriltJ* 
[Rji^y Wl«)iE^lRlS:ffiofcffiSai"C x=-kl • tanh 



* ynew = y old —AM ••• (2) 

[0 0 3 5] gjjip] 1 $mmirZ>m& (6*0(D 

*§£*) . Bjfe (xb , yb ) ^&5»flsttC^ (xc , 
yc ) ^tg*tWi^»i-S 0 roJfe|il<7><t>^ffiaiP c 

(XCE, YCE) XCESrmeft 6 ^ J:a*p}«f7C^S 

(f (6) t<7>£: LT. 

XCE= f (6) - (3) 

YCE— (M$m$fotiX<D$-7±y h) =0 — (4) 

[0036] £b\z* m\B\<Dm^nec w\ #*9ffi« 

^^«^WX*^t7t?/ h^rXff tit, 
0c = AM/ (XCE-XW ) ■-• (5) 

[0 0 3 7] ilE^'frffifltP c (XCE, YCE) , Mmfi 
20 0c SrflH^T, telH]^fTB#r*(i, (xold , yold 

) X^m1M\<D 2?k5t^ V'T'te, JffiSC (xnew , ynew 

r= ( (xold -XCE) 2 + (yold - YCE) 2 ) 1/2 
a=arctan ( (yold - YCE) / (xold -XCE) ) 

(a + 0c ) + XCE ••■ (6) 

(a + 0c ) 4- YCE ■•■ (7) 

(k2 • y) . (kl ttlift) )6SjiD(ftL3 ^tSii^ 
30 LT^Ptl#afit?«lSjiG»L3 t-ffi 5 <t 5 5 0 

[0 0 4 1] ±IJ^*ffi«*j£» 2 7 ^fflfigit^ 

B(rfB^^K/^#l"fe^6^e>^^^K/wfii, ±IB2 
«C5c^y^fP^«P2 5^feC0 2»C7C^s/^S<3#, r 
CD 2 #c5g^ ^ ^.h-e S Mm 1 ^roD£l£ (D jgte^tffi 

[0 0 4 2] ±IB«*a$iJ^aS 2 8 tt, _b|SSSSSSSI@ 
g|5 2 6T*»fc3B3HK*i±ET*ffi««t«<B2 7t* 

^fc^ffififi i ^r^J* U ±SE 2 ^ zffcfSM 2 5 

^«Lfc2JJC7C^iy^ p Ji{i*^**Sli:5 <t 5 id, iu 

S±5fc®riiSaxT*3 9, ±E**P«J»8S2 8ir(35tt: 

50 Cttttt««*»8S:a5-it±9, © ; 



[0 0 4 3] ±IB«rtK:£5*Kffl»E*«3fiB 

60 /n^7A^^-ht5i:^ *1\ .**ry? (Si 
T TSj 10 1T\ jJtiiiry^^Jc^ 

^K^eSTtfttULTtt^iitfirirtl-^ fet^CCD 

B 4 Dgj&SlBfHS 2 l t^Bt 9 iitfo -^lH^^r^ 

BMft»tt, ±iBH«««WfB 2 1 -r, »*i-5<ttfi<oTft 
i^&ha ay* <nmm k j: o x mm&» izm 3 tmmn 

■«*s**StbTiIIS«tt • l*#M8tt8lS2 2ic|±l^$ 
ixSe *tt, r.tf>ii&7l£R • »#*>K»*B2 2T\ ± 

(ont-m-fttefrfix, jhia»6i»3pj*»3a«fi5 

2 3 i:±IS2»c5c"^5/^ , fPfiK*B5 2 5 ^JH§ 
k>*>. itK-l»**1»«©«lE*ii*dSfTtoixS) □ 
[0 0 4 4 J *<ofg N s 1 o 2d:ii*, ittT^rrpl (S* 

iHBDSrtfefflU itBDfca<:Wl^«ffoa^cBWR 

Lfctt <£ 9 /hS < , **<B**:«W|;: 1 0 

cm(7>5fe»5^Sr*P*UfcffiK-h (W+10^D<W+4 

o) (7)itffiD^^Ki: tt, immv<om& (w+io 

>D*ifc:fci:D^W+4 0 US 1 0 3 i^itt? 0 

[0 04 51 -hlBS 103 -Cfciu £ &K:±fBiiK 

D ^ W+ 4 0 OSgSOJf^ttLkSB SIOKCI^ fflfif 

^■rtBfciiBS, w+ i o >DCDii&g<£>4§£i* 

S 1 0 4 — irittfo fik -bIBS 102, S103l^ 
[0 0 4 61 ±15 S 1 0 4fcittfir, #&ftl!W£|S 2 4 

[0 0 4 7] — ±ffiS 1 0 2 g Utp] 1 ^iitT^foJ 
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fcl8M&aS#5*fr (W+10^D<W+4 0«^) fc* 
S 1 0 5^iitfo -^S 1 0 Sfcigtfi:, ±12 2 
3>:^f&*|R2 «SE"f52»C7C^y^*/^-^>' 

(itB • »«•*«) (WE) fcf&fcbfc 

«*MfcB*« (2*56-^^^ SrJJc^JcMlSffLT, 
l ^ifefTJfrfiSrg'ifS *M l mm<om9t<o 2 Kkfc^ v 

[0 0 4 81 ^^t, S 1 0 6^Jt* % SfflSSg^®^ 
10 2 6 T% ±ffi 2 ^x;-^ ^J*a 2 5 L/c2 #:5t 

[0 0 4 91 #^t% s i o 7^it*, ^fflffifi#i3£SB 

2 7T% a>-K/^6, iWoiiSV, 2»Ctc-^^^S 

20 [0 0 5 0] LT, S 1 0 8 — ilA,T% ffi^afflffilfflS 2 

i^-Ti; 5fc±ffi2 2fe5u^y^ p ^ffl5 2 5 -Cf^*Lfc2 

[0 0 5 11 ^«)fc«)iiKtH:««**»8 Srft5 ^ t 
^XY), |»*«^|ll38^ffitt*»S^BB^#5ii 

fcfc. rttd*&fi i 5'<#We»fPt>**<*»l-BBt? 

30 ^ 0 

[0 0 5 21 ^(-, H4tt2»C7C^iy7 p f^*»2 5tH 
fT^n^ 2?fc7n^syp p ^/v— f^7D- h^r 
*U -CD/^— h £th& t. *i\ S20 

*4:W-»«FlRl3&>6>«Jt) , SulHlco2^^>>7 e ^Sg^ 
S 2 0 2 izmAs-VMIfcfi 6 

«i^it:itttffi^ar*i^b, mmikm<DM&\axs 203 
i-it^, teinj^^^i-^s 204 tcm&o 
[0053] ±es 2 0 2T?mmvzmkmfeLxs 2 o 
40 3i^ittfir, ^{ii^2^^^7 (, (^*:fM#t!iSAM^n 
fix (bwb (1) *, (2) *te*-3<ffia*fTfco 

T) , S 2 0 6 fcittfo 
[0 0 5 4] — ±I5S 2 0 2X'MmVtnkmi£l,X 

t-tPC , jKeIU^0c SrStbL (SufS (3) St, (4) 

sc, (5) s:(^^<^ta) , s 2 o 5 imA,xwm<D 

2^7c^5/^4r±IB^IU^^PC Sr^-L^dSElUft 6 c ID 

te^-^r aitrffi (e) ' (7) *fc*<3<*aas:fT*o 

T) , S 2 0 6 liiitfo 
50 [0 0 5 5] ±BES 2 0 3 fc^>V^^±fES 2 0 SfrbS 
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[0 0 5 6] #^T% S 2 0 7 Kit*, ifr[H]CQ 2 ^tc^ 
S/^f-C, ±fES 2 0 3 fc£V^2_kfeS 2 0 5 

[oo5 7] ^(d, s 2 0 8(cii^. N espii^bafc 

2 0 9K:itA,T\ ±1BS 2 0 7-ejKJ5ELfcHulHl<7>2J!k5c 10 

[0 0 5 8] fSL ielt$^c^[E]Offfe^2^5c^^^ 
12, *IH«IW^n^5A3SSS6fTSix*»»2:tt, WOO 2 

Wfll*^ffSt5l»*ftl!:»t5aE3t«t*. 
[0 0 5 9] W_t<£> J: 5 K:**?^**©* l J: 

[00 60] EI 1 0 1 3 tt**M<D|H!lfic09S 

2 9.H10 tt*P5fflaaES«K«<z>ttWB^ 30 

Hi 2tt3feK^f>r KMlW^^n— ^ — K Hi 3^ 
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(54) OPERATION SUPPORTING DEVICE FOR VEHICLE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a 
certain, reliable, and practical operation 
supporting device in which a driver can travel in 
a narrow road by evading contact with an 

i r-- — -* — : ~i 

I t obstacle by easily and quickly making accurate 
judgment. 

!~l3««-« SOLUTION: A speed V and a handle angle 9 are 
detected, the environment of a traveling 
direction is image picked up by a CCD camera 3, 
and the calculation of relative position 
information is operated by a picture recognizing 
part 21 and a road shape and obstacle 
recognizing part 22. When a narrow road is 
present in the direction of travel according to 
judgment by a narrow road judgment processing part 23, second-dimensional maps 
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prepared in the past are successively updated, and the second-dimensional map of 
environment in the surrounding of a vehicle including the direction of travel is prepared 
by a second-dimensional map preparing part 25. Afterwards, an ideal path when the 
vehicle is intruding into the narrow road is calculated based on the second- dimensional 
map by an ideal path calculating part 26, and an expected position after the set time of a 
vehicle 1 is expected on the second-dimensional map by an expected position estimating 
part 27. Then, an announcement controlling part 28 outputs a signal to a state display 
part 8, and the ideal path is synthesized with the expected position and displayed on the 
second-dimensional map. 
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CLAIMS 



[Claim(s)] 

[Claim l] Operation support equipment for vehicles characterized by providing the 
following. A run state detection means to detect a self-rolling-stock-run state. A run 
environmental detection means to detect the passage configuration and solid object of 
the above-mentioned self-roliingstockrun direction. Environmental positional 
information means forming which forms the positional information of the 
above-mentioned run state, the above-mentioned passage configuration, and the 
environment of the above-mentioned self-vehicles circumference that includes the 
above-mentioned self- rolling- stock-run direction based on the above-mentioned solid 
object information. An ideal path operation means to calculate the path of an ideal in 
which the above-mentioned self-vehicles advance into this narrow road in case there is a 
narrow road in the above-mentioned self-rolling-stock-run direction, A future -position 
presumption means to presume the future position of the above-mentioned self- vehicles 
after the setup time based on the above-mentioned run state of the above-mentioned 
self- vehicles, An information means to guide a narrow road run of the above-mentioned 
self-vehicles based on the future position of the above-mentioned self-vehicles presumed 
with the positional information of the environment of the above-mentioned self -vehicles 
circumference formed by the above-mentioned environmental positional information 
means forming, the above-mentioned ideal path calculated with the above-mentioned 
ideal path operation means, and the above-mentioned future -position presumption 
means. 

[Claim 2] The above-mentioned information means is operation support equipment for 
vehicles according to claim 1 characterized by displaying the future position of the 
above-mentioned self-vehicles presumed with the above-mentioned ideal path and the 
above-mentioned future -position presumption means which were calculated with the 
above-mentioned ideal path operation means on the positional information of the 
environment of the above-mentioned self-vehicles circumference formed by the 
above-mentioned environmental positional information means forming. 
[Claim 3] It is operation support equipment according to claim 1 or 2 for vehicles which 
carries out [ that the above-mentioned information means calculates the amount of 
speed corrections and the amount of rudder-angle corrections which make this amount 
of blanks the minimum, and displays them on predetermined while it calculates the 
amount of blanks from the above-mentioned ideal path of the above-mentioned future 
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position of the above-mentioned self-vehicles based on the above-mentioned future 
position which presumed with the above-mentioned ideal path and the above-mentioned 
future position presumption means which calculated with the above-mentioned ideal 
path operation means, and ] as the feature. 

[Claim 4] While the above-mentioned information means calculates the amount of 
blanks from the above-mentioned ideal path of the above-mentioned future position of 
the above-mentioned self-vehicles based on the above-mentioned future position 
presumed with the above-mentioned ideal path and the above-mentioned 
future -position presumption means which were calculated with the above-mentioned 
ideal path operation means The claims 1 and 2, operation support equipment for 
vehicles of any one publication of three which calculate the amount of speed corrections 
and the amount of rudder angle corrections which make this amount of blanks the 
minimum, carry out a voice output to predetermined, and are characterized by guiding 
a narrow road run. 

[Claim 5] The above-mentioned information means is operation support equipment for 
vehicles according to claim 4 characterized by carrying out by carrying out adjustable 
[ of the timing of the above-mentioned voice output ] according to the above-mentioned 
self-rolling-stock-run state. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] this invention relates to the operation 
support equipment for vehicles which supports operation of a driver so that the exact 
information about the possibility of contact with obstructions, such as a guard rail, a 
side attachment wall, and parking vehicles, may be offered and the penetration and the 
run to a narrow road etc. can be performed easily. 
[0002] 

[Description of the Prior Art] In order to aim at improvement in the safety of vehicles in 
recent years, the synthetic operation aide (AD A; Active Drive Assist system) which 
supports the operation of a driver positively is developed. This ADA system presumes 
various possibility such as a collision with precedence vehicles, contact with an 
obstruction, and lane deviation, from rolling-stock-run environmental information or a 
self-rolling- stock-run state, and when it is predicted that safety is unmaintainable, it 
performs information, other control, etc. to a driver. 

[0003] As equipment for obtaining the above -mentioned rolling-stock-run 
environmental information, although laser radar equipment etc. is better known than 
before, recently, it is becoming possible to process the scenery ahead of vehicles and the 
objective image information which were caught with two or more cameras carried in 
vehicles, and to recognize a passage and traffic environment in three dimensions in a 
practically sufficient precision and practically sufficient time. 

[0004] A parking auxiliary device is as a thing using the narrow road guide function 
which aims at the judgment of the propriety of the narrow road penetration which is one 
of the functions of the above-mentioned ADA system, and contact prevention with an 
obstruction, and guides a run of a narrow road, for example parking space determines to 
JP,6-234341,A, and the technology carry out voice directions efficiently that 
self-vehicles should guide to a parking position along the TWY which calculated based 
on physical relationship with a parking position and the current position is shown. 
[0005] 

[Problem(s) to be Solved by the Invention] However, in order to calculate based on 
physical relationship with a parking position and the current position, when 
obstructions, such as a telegraph pole and a curbstone, exist in before a parking position, 
the correspondence is difficult for the TWY of the above-mentioned advanced technology 
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[0006] Namely, no matter it may be formed in the direction it runs in consideration of 
there being various obstructions, it may compare and there may be what obstruction, an 
operator avoids this effectively and needs to enable it to run this easily in the narrow 
road guide which must be made to correspond to various situations of an except when 
making a car park. 

[0007] No matter what obstruction this invention might be made in view of the 
above-mentioned situation, and it may compare it in the direction it runs and it may 
have, this is reported to an operator, and it is certain and aims at the thing which guide 
so that an operator may make a quick adequate judgment easily, contact with an 
obstruction may be avoided and a narrow road run can be performed and for which the 
high operation support equipment for vehicles of reliability and practicality is offered. 
[0008] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, the 
operation support equipment for vehicles by this invention according to claim 1 A run 
state detection means to detect a se If -rolling- stock-run state, and the passage 
configuration of the above-mentioned self-rollingstockrun direction and a run 
environmental detection means to detect a solid object, The above-mentioned run state, 
the above-mentioned passage configuration, and the environmental positional 
information means forming that forms the positional information of the environment of 
the above-mentioned self- vehicles circumference which includes the above-mentioned 
self rolling-stock-run direction based on the above-mentioned solid object information, 
An ideal path operation means to calculate the path of an ideal in which the 
above-mentioned self-vehicles advance into this narrow road in case there is a narrow 
road in the above-mentioned self-rolling- stock- run direction, A future-position 
presumption means to presume the future position of the above-mentioned self-vehicles 
after the setup time based on the above-mentioned run state of the above-mentioned 
self-vehicles, It has an information means to guide a narrow road run of the 
above-mentioned self-vehicles based on the future position of the above-mentioned 
self-vehicles presumed with the positional information of the environment of the 
above-mentioned self vehicles circumference formed by the above-mentioned 
environmental positional information means forming, the above-mentioned ideal path 
calculated with the above-mentioned ideal path operation means, and the 
above-mentioned future-position presumption means. 

[0009] The operation support equipment of the claim 1 above-mentioned publication for 
vehicles forms the positional information of the environment of the above-mentioned 
self- vehicles circumference which detects a self- rolling- stock-run state with a run state 
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detection means, detects the passage configuration and the solid object of the 
above-mentioned self-rolling stock run direction with a run environmental detection 
means, and includes the above-mentioned self-rolling-stock-run direction based on the 
above-mentioned run state, the above-mentioned passage configuration, and the 
above-mentioned solid object information by environmental positional information 
means forming. And the path of an ideal in which the above-mentioned self-vehicles 
advance into this narrow road in case there is a narrow road in the above-mentioned 
self-rolling-stock-run direction with an ideal path operation means is calculated. Based 
on the above-mentioned run state of the above-mentioned self-vehicles, the future 
position of the above-mentioned self- vehicles after the setup time is presumed with a 
future -position presumption means. Based on the future position of the 
above-mentioned self-vehicles presumed with the positional information of the 
environment of the above-mentioned self-vehicles circumference formed by the 
above-mentioned environmental positional information means forming, the 
above-mentioned ideal path calculated with the above-mentioned ideal path operation 
means, and the above-mentioned future-position presumption means, a narrow road 
run of the above-mentioned self-vehicles is guided with an information means. 
[0010] Moreover, the operation support equipment for vehicles by this invention 
according to claim 2 In the operation support equipment for vehicles according to claim 
1 the above-mentioned information means It is what displays the future position of the 
above-mentioned self-vehicles presumed with the above-mentioned ideal path and the 
above-mentioned future -position presumption means which were calculated with the 
above-mentioned ideal path operation means on the positional information of the 
environment of the above-mentioned self-vehicles circumference formed by the 
above-mentioned environmental positional information means forming. While an 
operator can recognize the possibility of evasion of an obstruction easily by checking by 
looking the future position of the above-mentioned ideal path displayed on the 
environmental positional information of the above-mentioned self-vehicles 
circumference, and the above-mentioned self- vehicles The operation which should be 
performed from now on, and the obstruction information which can recognize easily 
quickly and has not been noticed can be known. 

[001 1] Furthermore, the operation support equipment for vehicles by this invention 
according to claim 3 In the operation support equipment for vehicles according to claim 
1 or 2 the above-mentioned information means While calculating the amount of blanks 
from the above-mentioned ideal path of the above-mentioned future position of the 
above-mentioned self-vehicles based on the above-mentioned future position presumed 
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with the above-mentioned ideal path and the above-mentioned future-position 
presumption means which were calculated with the above-mentioned ideal path 
operation means The amount of speed corrections and the amount of rudder angle 
corrections which make this amount of blanks the minimum are calculated, and it 
displays on predetermined, and an operator checks by looking the amount of speed 
corrections and the amount of rudder angle corrections which should be performed from 
now on, and can recognize more quickly the operation which should be performed from 
now on easily 

[0012] Moreover, the operation support equipment for vehicles by this invention 
according to claim 4 In claims 1 and 2 and the operation support equipment for vehicles 
of any one publication of three the above-mentioned information means While 
calculating the amount of blanks from the above-mentioned ideal path of the 
above-mentioned future position of the above-mentioned self-vehicles based on the 
above-mentioned future position presumed with the above-mentioned ideal path and 
the above-mentioned future -position presumption means which were calculated with 
the above-mentioned ideal path operation means The amount of speed corrections and 
the amount of rudder angle corrections which make this amount of blanks the minimum 
are calculated, a voice output is carried out to predetermined, a narrow road run is 
guided, and even if an operator cannot check a display in the car etc. by looking and 
cannot check an obstruction position,, he is guided in it so that the above-mentioned 
ideal path may certainly be met. 

[0013] Furthermore, in the operation support equipment for vehicles according to claim 
4, the above-mentioned information means carries out adjustable [ of the timing of the 
above-mentioned voice output] according to the above-mentioned self-rolling-stock-run 
state, the operation support equipment for vehicles by this invention according to claim 
5 performs it, a voice guide is carried out with parameters, such as vehicles speed and 
acceleration, at a suitable stage, and operation becomes still easier. 
[0014] 

[Embodiments of the Invention] Hereafter, the gestalt of operation of this invention is 
explained based on a drawing. Drawing 1 - drawing 9 are involved in the 1st gestalt of 
operation of this invention, drawing 1 The functional block diagram of the operation 
support equipment for vehicles, The outline block diagram of the operation support 
equipment for vehicles and drawing 3 drawing 2 The flow chart of narrow road guide 
control, The flow chart of a two-dimensional map generating routine and drawing 5 
drawing 4 Explanatory drawing of the range of a narrow road judging. Explanatory 
drawing at the time of drawing 6 moving explanatory drawing of the solid object 
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positional information of the vehicles circumference, and drawing 7 moving the last 
solid object positional information, explanatory drawing showing an example with 
which drawing 8 sets an ideal path as the narrow road ahead of vehicles, and drawing 9 
are explanatory drawings showing an example of the display to a monitor. 
[0015] In drawing 2 , signs 1 are vehicles (self-vehicles), such as an automobile, it has 
the function to aim at judgment of the propriety of narrow road penetration, and contact 
prevention with an obstruction on these self-vehicles 1, as one function, and the 
operation support equipment 2 for vehicles which supports operation of a driver is 
carried. Hereafter, with the 1st gestalt of operation of this invention, only the judgment 
of the propriety of narrow road penetration of the operation support equipment 2 for 
vehicles and the portion of the function to aim at contact prevention with an obstruction 
are explained, and explanation is omitted about the portion of other functions. 
[0016] The above-mentioned operation support equipment 2 for vehicles has 1 set of 
CCD cameras (right and left) 3 using solid state image pickup devices, such as a 
charge -coupled device (CCD), as stereo optical system, and CCD camera 3 of these right 
and left is attached ahead [ of the vehicle interior of a room / ceiling ] with a fixed 
interval, respectively, and carries out the stereo image pck-up of the object outside a 
vehicle from a different view. And the video signal of the run direction of the 
self-vehicles 1 picturized by the 1 above-mentioned set of CCD cameras 3 is inputted 
into a control unit 4. 

[0017] Moreover, the above-mentioned operation support equipment 2 for vehicles is 
formed so that each signal from the vehicle speed sensor 5 which detects the speed of 
the above-mentioned self-vehicles 1, and the handle angle sensor 6 which detects a 
handle angle may be inputted into the above-mentioned control unit 4 as a run state 
detection means. The above-mentioned control unit 4 is based on each above-mentioned 
information (each signal from the video signal, the vehicle speed sensor 5, and the 
handle angle sensor 6 from CCD camera 3). The judgment of the propriety of narrow 
road penetration, That the function which aims at contact prevention with an 
obstruction and guides a run of a narrow road should be attained, it is constituted so 
that a control output may be carried out to an alarm 7 and the status-display section 8. 
[0018] The above-mentioned alarm 7 is a buzzer etc., when run to the narrow road of the 
size whose penetration is impossible, or when there is possibility of contact with an 
obstruction when a run is continued, emits an alarm tone by the output signal from the 
above-mentioned control unit 4, and reports it to a driver. 

[0019] Moreover, as shown in the monitor formed in in the car at drawing 9 according to 
the output signal from the above-mentioned control unit 4, the above-mentioned 



JP,11 016097,A 



status-display section 8 The physical relationship of the self-vehicles 1 and an 
obstruction (a wall HO., the parking vehicles HI, H2, and telegraph pole H3), It 
expresses as the two-dimensional map which looked at the ideal path RR for running 
future -position 1' after the setup time when the self-vehicles 1 maintain operational 
status with this (the handle angle 6, vehicles speed V) (for example, after 2 seconds), 
and a narrow road from the upper surface visually. By the case where it is shown in 
drawing 9 , it is blue, and in red, in the future position after the setup time, the ideal 
path RR is intelligibly displayed [ obstruction / each ] at color display, for example, as it 
is yellow. 

[0020] The above-mentioned control unit 4 is formed in a microcomputer and its 
circumference circuit, and as shown in drawing 1 , it mainly consists of the 
image -recognition section 21, a passage configuration and the obstruction recognition 
section 22, the narrow road judging processing section 23, the alarm control section 24, 
the two-dimensional map creation section 25, ideal path operation part 26, the 
future-position presumption section 27, and an information control section 28, 
[0021] The above-mentioned image recognition section 21 performs processing which 
searches for the distance information over the whole picture by the principle of 
triangulation from the amount of gaps of a corresponding position to 1 set of stereo 
picture pairs of the environment of the run direction of the self-vehicles 1 picturized by 
above-mentioned CCD camera 3, and it is formed so that the depth map showing the 
distance distribution of three dimensions may be generated and it may output to 
above-mentioned passage configuration and obstruction recognition section 22. 
[0022] Above-mentioned passage configuration and obstruction recognition section 22 
recognize solid objects, such as a passage and an obstruction, etc. by performing 
histogram processing about the distance distribution of the depth map from the 
above-mentioned image-recognition section 21, calculates the relative-position 
coordinate (relative position information) of the solid object seen from the self-vehicles 1, 
and outputs it to the above-mentioned narrow road judging processing section 23 and 
the above-mentioned two-dimensional map creation section 25. 

[0023] That is, the run environmental detection means is formed as mentioned above in 
above-mentioned CCD camera 3, the image-recognition section 21, and the 
above-mentioned above-mentioned passage configuration and obstruction recognition 
section 22. 

[0024] The above-mentioned narrow road judging processing section 23 judges whether 
a narrow road is in the setting range in transverse plane of abbreviation of the run 
direction of the self-vehicles 1 based on the relative-position information on the run 
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direction of the self-vehicles 1 inputted from above-mentioned passage configuration 
and obstruction recognition section 22. 

[0025] Here, as shown in drawing 5 , when the run direction is the front, the 
above-mentioned setting range is a range from the body front end to about 20m, and are 
line u2L which added the margin to the outside of right and left of the range surrounded 
by tangent alL of the outermost marginal part (for example, door mirror) of right and 
left of the self -vehicles 1 which extended ahead of the self vehicles 1, and aTR, and this 
range, respectively, and a range surrounded by a2R. In addition, line a2L' which added 
the margin greatly gradually as it became far away and a2R' It is good also as a range 
surrounded. 

[0026] The interval of obstructions, such as a wall of the guard rail of the vehicles which 
super-low-** or are standing it still in the run direction, and a passage edge, a curbstone, 
and a house, is measured, and the substantial width of road, such as a passage, is 
detected, and by the width of road, the maximum width of the body of the self-vehicles 1, 
and the relation for a margin For example, it is smaller than the value to which the 
width of road added a part for a 40cm margin to the maximum width of the body, and 
beyond the value that added a part for a 10cm margin to the maximum width of the 
body, in a certain case, it judges with those with a narrow road, and outputs to it at the 
above-mentioned two-dimensional map creation section 25. 

[0027] Moreover, as a result of a judgment, when it is judged in the above-mentioned 
narrow road judging processing section 23 whether it can have a margin enough 
[ further ] and can pass, when you have no narrow road and it judges with passing being 
impossible (there is no path through which has only passing width of face narrower 
than the value which added a part for a 10cm margin to the maximum width of the body, 
or it can completely pass), it outputs to the above-mentioned alarm control section 24. 
[0028] The above-mentioned alarm control section 24 is a signal from the 
above-mentioned narrow road judging processing section 23, and emits an alarm tone 
from the aforementioned alarm 7 that the cautions through which it cannot pass should 
be carried out to an operator. Volume is so large that it is close to an obstruction, and the 
alarm tone in this case can also be effectively reported to an operator, as the alarm 
interval which was being performed by carrying out intermittence also becomes short. 
Furthermore, when the collision with an obstruction is not avoided clearly, 
automatic-braking-system equipment (not shown) operates. 

[0029] The handle angle 8 which the above-mentioned two-dimensional map creation 
section 25 was formed as environmental positional information means forming, and was 
detected by the aforementioned handle angle sensor 6 The environmental positional 
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information (two-dimensional map) created in the past (last time) is updated one after 
another based on the relative-position information from the vehicles speed V, and the 
above-mentioned above-mentioned road configuration and obstruction recognition 
section 22 detected by the aforementioned vehicle speed sensor 5. The two-dimensional 
map of the environment of the self-vehicles 1 circumference including the run direction 
of the self-vehicles 1 is formed, and it outputs to the above-mentioned ideal path 
operation part 26 and the above-mentioned future -position presumption section 27. 
[0030] As shown in drawing 6 , the environmental positional information 
(two-dimensional map) of the above-mentioned vehicles circumference is the positional 
information of the solid object in the field QRST centering on the self-vehicles 1 
beforehand set up on XY flat surface, and is formed for the relative position information 
(information in Field PQR) from above-mentioned road configuration and obstruction 
recognition section 22 which calculated this time and was obtained, and the information 
from above-mentioned road configuration and obstruction recognition section 22 
obtained by last time. 

[0031] namely, the field (two-dimensional map) Q of the solid object positional 
information which calculated last time and was memorized - 'R* - S — T f from - If the 
self-vehicles 1 move (movement magnitude M=(vehicle speed) - (measurement time)) 
and the relative-position information on Field PQR is newly acquired from 
above-mentioned road configuration and obstruction recognition section 22 this time the 
field Q of the last two-dimensional map - *R' - S - T Only the above-mentioned 
movement magnitude M moves, and while updating so that it may become the 
information over this vehicles position the field Q of this updated last two-dimensional 
map - 'R' - S - T from - with data (data of field TSS' TO, although it came out out of 
the storage region The data of the field PEF which overlaps the relative-position 
information on the newly obtained field PQR are eliminated, the relative-position 
information on the above-mentioned field PQR is added, and the field QRST of this 
two-dimensional map is formed. In addition, although drawing 6 shows by the case 
where vehicles carry out advance movement in order to make it intelligible, when 
vehicles carry out revolution movement, this two-dimensional map is called for similarly. 
[0032] And by guiding a narrow road run using such a two-dimensional map The solid 
object once recognized in the direction of a rolling stock run as well as the ability to 
recognize the position of the solid object in the direction of a rolling stock run like before 
A solid object can be recognized in the large range of the vehicles circumference, without 
being able to grasp the position and adding a camera or solid object recognition 
equipment to others specially, even when it is a method of vehicle both sides with 
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movement of vehicles. 

[0033] Here, in order to move the positional information of the last solid object based on 
the movement magnitude of the detected self-vehicles 1, the following calculation 
formulas perform. 

[0034] In drawing 7 , when the self-vehicles 1 go straight on, the body in A points (xa 
and ya) moves relatively [ points / B / (xb and yb) ] (xa =xb). Here, if the real rudder 
angle by the handle angle 0 is set to 8, it is 8= 0, and it will be set to yb =ya- AM, using 
movement magnitude of vehicles as A M at the time of a rectilinear-propagation run. 
That is, in the time of a rectilinear-propagation run, the last two-dimensional map 
shown with a coordinate (xold and yold) is moved to this new two-dimensional map 
shown with a coordinate (xnew and ynew) by the following two formulas, 
xnew =xold - (l) 
ynew =yold- AM- (2) 

In addition, if the above-mentioned real rudder angle 8 is a value within the limits 
beforehand set up even if it was not 0 strictly, it will regard it as a 
rectilinear-propagation run. An adjustable setup of this setting range may be carried 
out with parameters, such as the vehicle speed. 

[0035] Moreover, when the self-vehicles 1 circle, the body in B points (xb and yb) moves 
relatively [ points / C / (xc and yc) ] (when it is 8!=0). The main coordinate Pc (XCE, 
YCE) of this revolution is XCE=f (8) as that for which it asks by reference of Oble 
which set up XCE beforehand based on the vehicles item by the real rudder angle 8 (f (8) 
shows). (3) 

YCE=(offset to axis arm) =0 - (4) 
It becomes. 

[0036] furthermore, angleofrotation 0c of revolution offset of the direction of X from a 

camera position to a left rear ring - XW ** - carrying out — 

0c =AM/(XCE-XW) - (5) 

It is come out and computed. 

[0037] The above-mentioned main coordinate Pc (XCE, YCE) and revolution angle 0c It 
uses and the last two-dimensional map shown with a coordinate (xold and yold) is 
moved to this new two-dimensional map shown with a coordinate (xnew and ynew) as 
follows in the time of a revolution run. 

r=((xold -XCE)2 +(yold YCE)2 )l/2a=arctan((yold YCE)/(xold -XCE)) 
When it carries out, it is. xnew =r cos+(a+0c) XCE - (6) 
ynew =r sin+(a+0c) YCE - (7) 

The above-mentioned ideal path operation part 26 is formed based on the 
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two-dimensional map calculated in the above-mentioned two-dimensional map creation 
section 25 as an ideal path operation means to calculate the path of an ideal in case 
there is a narrow road in the run direction of the self-vehicles 1 and the self-vehicles 1 
advance into this narrow road, and the ideal path searched for by this ideal path 
operation part 26 is outputted to the above-mentioned information control section 28. 
[0038] For example, as shown in drawing 8 (a), they are the parking vehicles Hi as an 
obstruction to the front of the self-vehicles 1. Parking vehicles H2 There is a narrow 
road SP (between Ongent and the straight line Ll of the left-hand side outermost edge of 
the parking vehicles HI, and Ongents and straight lines L2 of the right-hand side 
outermost edge of the parking vehicles H2) formed. When calculating the path of the 
ideal for advancing into this narrow road SP, a two-dimensional map as shown in 
drawing 8 (b) as information on two-dimensional map creation section 25 empty- vehicle 
both the above-mentioned circumferences is inputted. 

[0039] And as shown in drawing 8 (c), it is a straight line L2 on this two-dimensional 
map. Straight line L3 which gave the margin beforehand set to the narrow road SP side 
It lengthens. Parking vehicles HI and H2 An intersection with the straight line by the 
side of the self-vehicles 1 is set to Ptl, and it is a telegraph pole H3. A margin is given to 
the circumference by fixed width of face, and the highest point of the possibility of 
contact to the self-vehicles 1 side is set to Pt2. 

[0040] For x=kl and tanh (k2 and y), and (kl) is a straight line L3 about one at the 
system of coordinates which took the right direction of the y-axis in the direction to 
which this point Pt2 is made into a zero, and a narrow road SP is gone. It considers as 
an asymptote and is a straight line L3 mostly in the point Ptl neighborhood. It sets up 
so that it may meet. Curve L4 made by this formula A right- hand side orbit is also 
searched for as an ideal orbit along which the left-hand side outermost edge of the 
self-vehicles 1 passes. 

[0041] The above-mentioned future -position presumption section 27 is a thing as a 
future position presumption means. The vehicles speed from the aforementioned vehicle 
speed sensor 5, It is based on a two-dimensional map from the handle angle from the 
aforementioned handle angle sensor 6, and the above-mentioned two-dimensional map 
creation section 25. Setup time [ when the self-vehicles 1 maintain operational status 
with this on this two-dimensional map ] after The future position for which asked for 
the future position of (for example, 2 seconds after) by the equation of motion of the 
vehicles set up beforehand etc., and expected it by the vehicles item of the self-vehicles 1, 
and it asked is outputted to the above-mentioned information control section 28. 
[0042] It is formed in the status-display sections 8, such as a monitor formed to the 
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aforementioned vehicle interior of a room, so that a signal output may carry out, and an 
information means is formed in the above-mentioned information control section 28 and 
this status-display section 8 so that the above-mentioned information control section 28 
compounds the ideal path searched for by the above-mentioned ideal path operation 
part 26, and the future position for which it asked in the above-mentioned 
future -position presumption section 27 and it may make display on [ both ] the 
two-dimensional map created in the above-mentioned two-dimensional map creation 
section 25. for this reason, an operator - the status-display section 8 - **** - by things, 
the operation which should be performed from now on while being able to recognize the 
possibility of evasion of an obstruction easily and the obstruction information which can 
recognize easily quickly and has not been noticed can be known now 
[0043] Next, an operation of the operation support equipment for vehicles by the 
above-mentioned composition is explained based on the flow chart of drawing 3 . First, if 
a program starts, while the vehicle speed sensor 5 will detect the speed V of the 
self-vehicles 1, and the handle angle sensor 6 will detect the handle angle 0 of the 
self-vehicles 1 and reading at Step (it is called "S" for short below) 101, the environment 
of the run direction of the self-vehicles 1 is picturized by CCD camera 3 on either side, 
and it incorporates in the image -recognition section 21 of a control unit 4. 1 set of these 
stereo picture pairs are the above-mentioned image -recognition sections 21, and 
processing which searches for the distance information over the whole picture by the 
principle of triangulation is performed from the amount of gaps of a corresponding 
position, the depth map showing the distance distribution of three dimensions is 
generated, and they are outputted to a road configuration and the obstruction 
recognition section 22. And in this road configuration and obstruction recognition 
section 22, solid objects, such as a road and an obstruction, etc. are recognized by 
performing histogram processing about the distance distribution of the depth map from 
the above-mentioned image-recognition section 21, calculation of the relative -position 
coordinate (relative-position information) of the solid object seen from the self- vehicles 1 
is performed, and it is outputted to the above-mentioned narrow road judging 
processing section 23 and the above-mentioned two-dimensional map creation section 
25 (that is, reading of a road and obstruction information is performed). 
[0044] Then, it progresses to S102 and the judgment of whether a narrow road is in 
travelling direction Gnside of the setting range in transverse plane of abbreviation of 
the run direction of the self-vehicles l) is performed. The interval of obstructions, such 
as a wall of the guard rail of the vehicles which super-low-** or are standing it still in 
the run direction, and a road edge, a curbstone, and a house, is measured, and the 
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substantial width of road D, such as a road, is detected, and by the width of road D, the 
maximum width W of the body of the self-vehicles 1, and the relation for a margin For 
example, it is smaller than the value which added a part for a 40cm margin to the 
maximum width W of the body, and by making into a narrow road the width of road D 
beyond the value which added a part for a 10cm margin to the maximum width W of the 
body (W+10 <=D<W +40), when you have no narrow road (in the case of W+10>D or 
D>=W +40), it progresses to S103. 

[0045] In the above S103, it judges whether it is the path which can further pass 
through the above-mentioned path (path which is not a narrow road), when it is a path 
with sufficient margin to run, i.e., the path of D>=W +40, it returns to the above S101, 
and the case of the path through which it cannot pass, i.e., the path of W+10>D, 
progresses to S104. In addition, the above S102 and S103 is processings performed in 
the narrow road judging processing section 23. 

[0046] If it progresses to the above S104, the alarm control section 24 will emit an alarm 
tone from the alarms 7, such as a buzzer, that the cautions through which it cannot pass 
should be carried out to an operator. Volume is so large that it is close to an obstruction, 
and the alarm tone in this case is also effectively reported to an operator, as the alarm 
interval which was being performed by carrying out intermittence also becomes short. 
Furthermore, when the collision with an obstruction is not avoided clearly, 
automatic braking- system equipment (not shown) operates. And it escapes from a 
program after this processing of S 104. 

[0047] On the other hand, when a narrow road is in the travelling direction of the 
self-vehicles 1 by the above S102, it progresses to S105 (when it is W+10 <=D<W +40). If 
it progresses to these S105, the environmental positional information (two-dimensional 
map) created in the past (last time) in the above-mentioned two-dimensional map 
creation section 25 according to the two-dimensional map generating routine mentioned 
later based on the handle angle 0, the vehicles speed V, and relative -position 
information (a road and obstruction information) will be updated one after another, and 
the two-dimensional map of the environment of the self-vehicles 1 circumference 
including the run direction of the self vehicles 1 will be formed. 
[0048] Then, it progresses to S106, and in case there is a narrow road in the run 
direction of the self-vehicles 1 by the ideal path operation part 26 based on the 
two-dimensional map calculated in the above-mentioned two-dimensional map creation 
section 25, the path of an ideal in case the self-vehicles 1 advance into this narrow road 
is calculated. 

[0049] Subsequently, it progresses to S107, and in the future -position presumption 
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section 27, based on the handle angle 0, the vehicles speed V, and a two-dimensional 
map, it asks for the future position after the setup time when the self-vehicles 1 
maintain operational status with this on this two-dimensional map (for example, after 2 
seconds) by the equation of motion of the vehicles set up beforehand etc., and it is 
expected by the vehicles item of the self-vehicles 1. 

[0050] And compound the ideal path which carried out the signal output of the 
information control section 28 at the status-display sections 8, such as a monitor formed 
in the vehicle interior of a room,, and was searched for by the above-mentioned ideal 
path operation part 26, and the future position for which it asked in the 
above-mentioned future-position presumption section 27, and it is made to display by 
progressing to S108 on [ both ] the two-dimensional map created in the 
above-mentioned two-dimensional map creation section 25 as shown in drawing 9 , and 
escapes from a program. 

[0051] for this reason, an operator - the status-display section 8 - **** - by things, the 
operation which should be performed from now on while being able to recognize the 
possibility of evasion of an obstruction easily, and the obstruction information which can 
recognize easily quickly and has not been noticed can be known 

[0052] Next, if drawing 4 shows the flow chart of the two-dimensional map generating 
routine performed in the two-dimensional map creation section 25 and this routine 
starts it First, the real rudder angle 8 according to the handle angle 6 at S201, vehicles 
movement magnitude AM (from the vehicle speed and measurement time to an 
operation), After that, the last two-dimensional map is read, and it progresses to S202, 
and a revolution state or a rectilinear-propagation state is judged from the value of the 
real rudder angle 8, and, in the case of a rectilinear-propagation state, it progresses 
S203, and, in the case of a revolution state, progresses S204. 

[0053] If it judges with a rectilinear-propagation state by the above S202 and progresses 
to S203, vehicles movement magnitude AM will be added to the last two-dimensional 
map (performing processing based on the aforementioned (l) formula and (2) formulas), 
and it will progress to S206. 

[0054] When it judges with a revolution state by the above S202 and progresses to S204, 
on the other hand, the real rudder angle 8 Vehicles movement magnitude AM to the 
center line of rotation PC, and revolution angle 0c It computes (calculation based on the 
aforementioned (3) formula, (4) formulas, and (5) formulas). It progresses to S205 and is 
the above-mentioned center line of rotation PC about the last two-dimensional map. It 
is revolution angle 0c to a center. It is made to rotate (performing processing based on 
the aforementioned (6) formula and (7) formulas), and progresses to S206. 
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[0055] If it progresses to S206 from the above S203 or the above S205, although it came 
out out of the storage region by processing of the above S203 or the above S205, data 
will be eliminated in the last two-dimensional map. 

[0056] Subsequently, it progresses to S207 and the data which overlap the new 
relative-position information on a solid object by processing of the above S203 or the 
above S205 in the last two-dimensional map are eliminated. 
[0057] next, the last two-dimensional map which progressed to S208, read the 
relative-position coordinate (relative -position information) of the solid object seen from 
the self-vehicles 1, progressed to S209, and was formed by the above S207 the above - 
new relative-position information is added and memorized This solid object positional 
information is the new two-dimensional map updated this time. 

[0058] In addition, in case a control program is performed next time, this memorized 
new two-dimensional map is read as last two-dimensional map, and is processed. Thus, 
in order to create a two-dimensional map, even when the solid object once recognized 
ahead [ vehicles ] is a method of vehicle both sides with movement of vehicles, the 
position can be grasped, and it is possible to also offer easily operation support for the 
obstruction which exists in the method of vehicle both sides as well as the operation 
support for the obstruction which exists ahead [ vehicles ]. 

[0059] When making a car park as mentioned above according to the 1st form of 
operation of this invention, no matter it may compare in the direction it runs 
corresponding to various situations of an except and there may be what obstruction, this 
is reported to an operator, an operator makes a quick adequate judgment easily and 
contact with an obstruction is avoided, and it guides, and it is certain and becomes the 
high thing of reliability and practicality so that a narrow road run can be performed. 
[0060] Next, as for drawing 10 - drawing 13 , the functional block diagram of the 
operation support equipment for vehicles and drawing 11 of drawing 10 are explanatory 
drawings in which the outline block diagram of the operation support equipment for 
vehicles and drawing 12 show the flow chart of narrow road guide control, and drawing 
1.3 shows an example of the display to a monitor with respect to the 2nd form of 
operation of this invention. In addition, while the 2nd form of operation of this invention 
displays the future position of the self-vehicles presumed in the ideal path calculated by 
ideal path operation part, and the future position presumption section Based on the 
above-mentioned ideal path and the above-mentioned future position, the amount of 
blanks from the above-mentioned ideal path of the above-mentioned future position of 
self-vehicles is calculated. While calculating the amount of speed corrections and the 
amount of rudder angle corrections which make this amount of blanks the minimum 
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and displaying these on predetermined, according to a self-rolling-stock-run state, 
adjustable [ of the above-mentioned amount of speed corrections and the 
above-mentioned amount of rudder angle corrections ] is carried out, a voice output is 
carried out to predetermined, and a narrow road run is guided. 

[0061] In drawing 10 , a sign 41 shows the operation support equipment for vehicles, 
and the video signal of the run direction of the self-vehicles 1 which picturized this 
operation support equipment for vehicles by 1 set of CCD cameras 3 is inputted into a 
control unit 42. 

[0062] moreover, the above-mentioned operation support equipment 41 for vehicles like 
the 1st form of implementation of the aforementioned invention as a run state detection 
means It is formed so that each detecting signal from the vehicle speed sensor 5 and the 
handle angle sensor 6 may be inputted into the above-mentioned control unit 42. The 
above-mentioned control unit 42 is based on each above-mentioned information. The 
judgment of the propriety of narrow road penetration, That the function which aims at 
contact prevention with an obstruction and guides a run of a narrow road should be 
attained, it is constituted so that a control output may be carried out to an alarm 7, the 
status-display section 8, the operation guide display 43, left voice output section 44L, 
and right voice output section 44R. 

[0063] As shown in the monitor formed in in the car at drawing 13 according to the 
output signal (the amount of rudder angle corrections and the amount of speed 
corrections which are mentioned later) from the above-mentioned control unit 42, the 
above-mentioned operation guide display 43 is displayed with the above-mentioned 
status-display section 8 (area of Ap), it should just correct how many handle angles, 
should just correct how many the vehicle speed, or (area of APV) displays it visually. 
[0064] Moreover, the voice output sections 44L and 44R of the above-mentioned right 
and left It responds to an output signal (the above-mentioned amount of rudder angle 
corrections, and the amount of speed corrections) from the above-mentioned control unit 
42. If it is the directions to the left, while operating the above-mentioned left voice 
output section 44L, for example, carrying out [ "please turn a handle a little leftward" 
and ] a voice output using the sound signal beforehand recorded on the record medium 
If it is the directions to the right, the above-mentioned right voice output section 44R 
will be operated, for example, a voice output will be carried out [ "please turn a handle a 
little rightward" and ] (in adjustable directions of only speed, it carries out from voice 
output section 44L [ of the above-mentioned right and left ], and 44R both). 
[0065] The timing which carries out a voice output is beforehand changed from the voice 
output sections 44L and 44R of the above-mentioned right and left here by the present 
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vehicle speed and present acceleration with the above-mentioned control unit 42. For 
example,, if it becomes during acceleration even if the present vehicle speed is low, it will 
utter an early voice output, and if it becomes during a slowdown, it will utter a voice 
output later. 

[0066] The above-mentioned control unit 42 is formed in a microcomputer and its 
circumference circuit, and as shown in drawing 10 , it mainly consists of the 
image-recognition section 21, a road configuration and the obstruction recognition 
section 22, the narrow road judging processing section 23, the alarm control section 24, 
the two-dimensional map creation section 25, ideal path operation part 26, the 
future position presumption section 27, and an information control section 45. 
[0067] The above-mentioned information control section 45 compounds the ideal path 
searched for by the above-mentioned ideal path operation part 26, and the future 
position for which it asked in the above-mentioned future position presumption section 
27, and it is formed in the status-display sections 8, such as a monitor formed in the 
aforementioned vehicle interior of a room, so that it may be made to display on [ both ] 
the two-dimensional map created in the above-mentioned two-dimensional map 
creation section 25, and a signal output may be carried out. Moreover, the 
above-mentioned information control section 45 calculates the amount of blanks from 
the above-mentioned ideal path of the above-mentioned future position of the 
self-vehicles 1 based on the above-mentioned ideal path and the above-mentioned future 
position, and the amount of speed corrections and the amount of rudder angle 
corrections which make this amount of blanks the minimum are calculated based on a 
vehicles item. While outputting these to the above-mentioned operation guide display 
43, according to a self rolling stock-run state (the present speed, acceleration), 
adjustable [ of the generating timing ] is carried out and the signal output of the 
above-mentioned amount of speed corrections and the above-mentioned amount of 
rudder angle corrections is carried out at the voice output sections 44L and 44R of the 
above-mentioned right and left. That is, the information means is formed in the 
above-mentioned information control section 45, the status-display section 8, the 
operation guide display 43, and the voice output sections 44L and 44R on either side. 
[0068] With the 2nd form of operation of this invention with such composition, as shown 
in the flow chart of drawing 12 , a program is performed. The processing same to 
S101S107 as the 1st form of implementation of the aforementioned invention is 
performed, and the 2nd form of operation of this invention is the above S107. It 
progresses to S301, after asking for the future position after the setup time when the 
self-vehicles 1 maintain operational status with this on this two-dimensional map by 
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the equation of motion of the vehicles set up beforehand etc. and expecting it by the 
vehicles item of the self-vehicles 1 based on the handle angle 6, the vehicles speed V, and 
a two-dimensional map. 

[0069] In the above S301, based on the above-mentioned ideal path and the 
above-mentioned future position, the amount of blanks from the above-mentioned ideal 
path of the above-mentioned future position of the self-vehicles 1 is calculated by the 
information control section 45, and the amount of speed corrections and the amount of 
rudder angle corrections which make this amount of blanks the minimum are 
calculated based on a vehicles item. 

[0070] It progresses to S302. and the above-mentioned information control section 45 
While carrying out a signal output at the status-display sections 8, such as a monitor 
formed in the vehicle interior of a room, so that the above-mentioned ideal path and the 
above-mentioned future position may be compounded and it may be made to display on 
[ both ] a two-dimensional map While outputting and displaying the above-mentioned 
amount of speed corrections, and the above-mentioned amount of rudder angle 
corrections on the operation guide display 43 According to a self-rolling-stock-run state 
(the present speed, acceleration), adjustable [ of the generating timing ] is carried out, a 
signal output is carried out, and the voice output of the above-mentioned amount of 
speed corrections and the above-mentioned amount of rudder angle corrections is 
carried out to the voice output sections 44L and 44R of the above-mentioned right and 
left, and they carry out a run guide. 

[0071] Thus, with the 2nd form of operation of this invention, by in addition to the effect 
in the 1st form of the above, calculating the amount of speed corrections, and the 
amount of rudder angle corrections, and displaying these on predetermined, an operator 
checks by looking the amount of speed corrections and the amount of rudder angle 
corrections which should be performed from now on, and can recognize now more 
quickly the operation which should be performed from now on easily. 
[0072] Moreover, since the voice output of the amount of speed corrections and the 
amount of rudder angle corrections is carried out, even if an operator cannot check a 
display in the car etc. by looking and cannot check an obstruction position, he is guided 
in it so that the above-mentioned ideal path may certainly be met. And since it is carried 
out by carrying out adjustable [ of the timing of this voice output ] according to a 
self-rolling-stock-run state, a voice guide is carried out with parameters, such as 
vehicles speed and acceleration, at suitable time, and operation becomes still easier. 
[0073] In addition, although the example which formed the vehicle speed sensor and the 
handle angle sensor as a run state detection means explains, other sensors are added 
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further and you may make it control them by the form of implementation of each 
above-mentioned invention. For example, a yaw rate sensor etc. is prepared and it is 
good also considering a yaw rate as a control parameter. 
[0074] 

[Effect of the Invention] As explained above, no matter according to this invention it 
may compare in the direction it runs and there may be what obstruction, this is 
reported to an operator, and it is guided so that an operator may make a quick adequate 
judgment easily, contact with an obstruction may be avoided and a narrow road run can 
be performed, and the outstanding effect that it is certain and reliability and 
practicality are high is done so. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing l] It is involved in the 1st gestalt of operation of this invention, and is the 
functional block diagram of the operation support equipment for vehicles. 
[Drawing 2] The same as the above, the outline block diagram of the operation support 
equipment for vehicles 

[Drawing 3] The flow chart of the same as the above and narrow road guide control 
[Drawing 41 The flow chart of the same as the above and a two-dimensional map 
generating routine 

[Drawing 5] Explanatory drawing of the range of the same as the above and a narrow 
road judging 

[Drawing 6l Explanatory drawing of the same as the above and the solid object 
positional information of the vehicles circumference 

[Drawing 7] Explanatory drawing at the time of moving the same as the above and the 
last solid object positional information 

1 Drawing 8] Explanatory drawing showing an example which sets an ideal path as the 
narrow road the same as the above and ahead of vehicles 

[Drawing 9] The same as the above, explanatory drawing showing an example of the 
display to a monitor 

[Drawing IQl It is involved in the 2nd gestalt of operation of this invention, and is the 
functional block diagram of the operation support equipment for vehicles. 
[Drawing ll] The same as the above, the outline block diagram of the operation support 
equipment for vehicles 
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[Drawing 12] The flow chart of the same as the above and narrow road guide control 
[Drawing 13] The same as the above, explanatory drawing showing an example of the 
display to a monitor 
[Description of Notations] 

1 Self- Vehicles 

2 Operation Support Equipment for Vehicles 

3 CCD Camera (Run Environmental Detection Means) 

4 Control Unit 

5 Vehicle Speed Sensor (Run State Detection Means) 

6 Handle Angle Sensor (Run State Detection Means) 

7 Alarm 

8 Status-Display Section (Information Means) 

21 Image -Recognition Section (Run Environmental Detection Means) 

22 Passage Configuration and Obstruction Recognition Section (Run Environmental 
Detection Means) 

23 Narrow Road Judging Processing Section 

24 Alarm Control Section 

25 Two-dimensional Map Creation Section (Environmental Positional Information 
Means Forming) 

26 Ideal Path Operation Part (Ideal Path Operation Means) 

27 Future -Position Presumption Section (Future Position Presumption Means) 

28 Information Control Section (Information Means) 
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